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METHOD AND APPARATUS FOR ENCODING A PRODUCT CODE 

Background of the Invention 

1) Field of the Invention 

This invention relates to a method of encoding a 
product code and an apparatus therefor. 

2) Description of the Related Art 

It is known that on communication channels, errors 
occur randomly and in bursts. Random error correcting 
codes or single burst error correcting codes are either 
inefficient or inadequate and it is, therefore, desired to 
produce codes which are capable of correcting random 
errors and/or single or multiple bursts. 

A known technique is to use an interleaver with a so- 
called product code which is formed by, for ^xample, a 
two-dimensional code CxCy, where Cx is a linear code of 
overall length nx bits formed of kx data bits and having nx- 
kx parity bits. The other linear code Cy has overall 
length ny bits and is formed of ky data bits and ny-ky 
parity bits. The linear code CxCy is formed such that each 
code vector is a rectangular array of nx columns and ny 
rows in which every row is a code vector in Cx and every 
column is a code vector in Cy. Such a two-dimensional code 
is called a direct product of Cx and Cy. A three- 
dimensional code may be additionally formed having linear 
code bits Cz, comprising kz data bits, n^-kz parity bits and 
overall length nz bits . Such codes are described in "Error 
Control Coding: Fundamentals and Applications" by Lin and 
Costello, published by Prentice Hall Inc. at page 274. 
The same work also describes encoding of cyclic codes at 
page 95 thereof. 

Turbo codes are also known in which two encoders 
generate parity symbols from two recursive convolutional 
codes, each with a small number of states. The data bits 
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are typically transmitted uncoded. An interleaver 
permutes the original data bits before being applied to a 
second encoder. The permutation allows that input 
sequences, for which one encoder produces low weight code 
words, will usually cause the other encoder to produce 
high weight code words. Thus, even though the constituent 
codes are individually weak, the combination is extremely 
powerful . 

Turbo codes and turbo product codes allow good 
performance to be achieved by the employment of an 
iterative decoding algorithm using simple decoders which 
are individually matched to the constituent codes. Each 
constituent decoder sends a posteriori likelihood 
estimates of the decoded bits to another decoder and uses 
the corresponding estimates from another decoder as a 
priori likelihoods. The noisy encoded information bits 
from the channel are available to each decoder to 
initialise the a priori likelihoods. The turbo (product) 
decoder iterates between the outputs of the constituent 
decoders for a number of iterations, such that the final 
decoded output is a hard quantized version of the 
likelihood outputs of one of the decoders. 

A two-dimensional product code, which may be a turbo 
product code, is constructed by arranging an incoming data 
stream into a rectangular matrix of size kx columns by ky 
rows. Parity bits from a systematic code are calculated 
from each row of data to provide an array of size nx by ky. 
Parity bits are then calculated from each column of the 
horizontal encoded array to give a turbo product code 
encoded array of size nx by ny. The element encoded bits 
are then read out and passed to a channel for 
transmission. In a three-dimensional array, the array 
would be of size nxUynz. 
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A known turbo product code encoder is made by A.H.A. 
Inc. under type number 4501 IC, which comprises a 
processing core connected to RAM. Data arriving at the 
input of the encoder is stored in a memory. Once all the 
data bits for a block are present, encoding of the block 
commences. Parity bits are calculated by the encoder 
core. Only when all the parity bits have been calculated 
and the block is complete may the values be read out. The 
overall latency of such a design for a code with nx=ny=64 
and kx=ky=57 is 5,678 clock cycles. Thus, the latency, 
i.e. the number of clock cycles between applying data and 
reading out encoded data is lengthy. It may be considered 
that shortening the code would reduce the latency, but 
shortening the code is extremely difficult with the known 
architecture. If it is desired to shorten either the 
horizontal (x) and/or vertical (y) codes, it is necessary 
to insert zeros into the input stream to pad out the data 
array and then to remove the zeros from the encoded stream 
before passing the data to the transmission channel. 

Additionally, because of the complexity of the 
decoder at a receiver, the systematic codes from which the 
turbo product code parity bits are generated are 
restricted to very simple extended Hamming codes. 
Summary of the Invention 

The present invention seeks to provide a method of 
encoding a product code, which may be a turbo product 
code, which may be constructed from any convenient 
systematic block code in which the systematic bits occur 
in order, i.e. using not only Hamming codes, but also 
other types of systematic block codes. These might be 
other binary block codes, for example, low density parity 
check codes, but as will be understood by those skilled in 
the art, it is possible to construct product codes based 
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on codes which are based upon higher order Galois Fields 
instead of Hamming codes which are based on GF(2) . So as 
to produce Hamming codes, exclusive OR gates in an encoder 
perform addition modulo 2 . Such a function is referred to 
5 by mathematicians as GF{2) arithmetic. Codes exist which 
operate by taking as the sum modulo some other power of 2, 
e.g. A, 8, 256. Such codes operate on individual data 
elements which are larger than a single binary digit, e.g. 
the (255, 239) Reed - Solomon Code which operates on bytes 

10 and corrects 8 or less erroneous bytes out of 255 
(regardless of the number of bits in error in each 
erroneous byte) . The encoder for such a code takes 239 
bytes and appends 16 parity bytes using a similar, but 
more complex, structure than the Hamming encoder. The 

15 present invention is also applicable to such encoders. 

According to a first aspect of this invention there 
is provided a method of encoding a product code having a 
first dimension systematic block code of length nx elements 
and a second dimension systematic block code of length n^ 

20 elements including the steps of: 

(a) applying a data element stream to first 
dimension encoder means to produce said first 
dimension systematic block code having k^ data 
elements and Ux-kx parity elements, where said 

25 parity elements are derived from said kx data 

elements, 

(b) repeatedly applying said data element stream to 
said first dimension encoder means to produce ky 
first dimension code vectors, where ky is the 

30 data element length of the second dimension 

systematic block code, 

(c) as each one of said ky first dimension code 
vectors is produced, outputting said first 



dimension code vectors to second dimension 
encoder means representative of nx encoders, 

(d) deriving (nxny-nxky) parity elements for said 
second dimension systematic block code vectors, 
and 

(e) output ting second dimension code vectors as each 
is produced so as to provide said encoded 
product code. 

Preferably, said product code is a turbo product 

code . 

In an embodiment, said second dimension encoder means 
comprises nx encoders each producing a total of Uy second 
dimension encoded elements from ky input data elements or 
first dimension parity elements. 

Because such an embodiment requires a large number of 
encoders, in a preferred embodiment, said first dimension 
systematic block code is applied in sequence to said 
second dimension encoder means and said second dimension 
encoder means includes a parity generator having a random 
access memory (RAM) associated therewith thereby 
repeatedly clocking data and parity elements in to an out 
of said RAM to synthesize said nx encoders. 

Preferably, said systematic block code is a Hamming 
code and, advantageously, an extended Hamming code. In 
such an embodiment, said data element is a single binary- 
bit but, in an alternative embodiment, said data element 
has a length of two or more binary digits. 

Advantageously, said first dimension encoder means 
includes a Hamming parity generator provided to produce 
said parity elements of said first dimension systematic 
block code and, preferably, also includes an extended 
Hamming parity generator adapted to receive output from 
said Hamming parity generator to produce an extended 
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Hamming parity element for said first dimension systematic 
block code. 

Conveniently, said second dimension encoder means 
includes a further Hamming parity generator connected to 
5 receive output from said extended Hamming parity generator 
so as to produce said parity elements of said second 
dimension systematic block code and, preferably, said 
second dimension encoder means also includes a further 
extended Hamming parity generator adapted to receive 

10 output from said further Hamming parity generator so as to 
produce said encoded product code. 

Advantageously, the output counter value of a first 
dimension counter having a range 0 to nx-1 is applied to 
control signal generator means which supplies a clocking 

15 signal to a second dimension counter having a range 0 to 
ny-l, and said control signal generator means applies 
control signals to said first and second dimension encoder 
means according to the output values of both of the 
aforesaid counters. 

2 0 According to a second aspect of this invention there 

is provided an apparatus for producing a product code 
having a first dimension systematic block code of length nx 
elements and a second dimension systematic block code of 
length ny elements, said apparatus including first 

25 dimension encoder means for receiving a data element 
stream to produce therefrom said first dimension 
systematic block code having kx data elements and nx-kx 
parity elements, where said parity elements are derived 
from said kx data elements, said first dimension encoder 

30 means being arranged to produce ky first dimension code 

vectors, where ky is the data element length of the second 
dimension systematic block code, and second dimension 
encoder means representative of n^ encoders, said second 



dimension encoder means being arranged to receive said 
first dimension code vectors as they are produced and 
deriving (nxny-nxky) parity elements for said second 
dimension systematic block code, whereby said second 
encoder means is arranged to output second dimension code 
vectors as each is produced so as to produce said encoded 
product code . 

Preferably, said product code is a turbo product 

code . 

In an embodiment, said second dimension encoder means 
comprises n^ encoders each producing a total of % second 
dimension encoded elements from ky input data elements or 
first dimension parity elements. 

In a preferred embodiment, said second dimension 
encoder means includes a parity generator having a RAM 
associated therewith, whereby said first dimension 
systematic block code is applied in sequence to said 
parity generator and control signal generator means are 
provided for repeatedly clocking data and parity elements 
in to and out of said RAM so that nx encoders are thereby 
synthesized. 

Preferably, said systematic block code is a Hamming 
code and, advantageously, an extended Hamming code. In 
such an embodiment, said data element is a single binary 
digit but, in an alternative embodiment, said data element 
has a length of two or more binary digits. 

Advantageously, said first dimension encoder means 
includes a Hamming parity generator provided to produce 
said parity elements of said first dimension systematic 
block code and, preferably, said first dimension encoder 
also includes an extended Hamming parity generator adapted 
to receive output from said Hamming parity generator so as 
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to produce an extended Hamming parity element for said 
first dimension systematic block code. 

Conveniently, said second dimension encoder means 
includes a further Hamming parity generator connected to 
receive output from said extended Hamming parity generator 
for producing said parity elements of said second 
dimension systematic block code and, preferably, said 
second dimension encoder also includes a further extended 
Hamming parity generator adapted to receive output from 
said further Hamming generator so as to produce said 
encoded product code. 

Advantageously, the output counter value of a first 
dimension counter having a range 0 to n^-l is applied to 
control signal generator means which supplies a clocking 
signal to a second dimension counter having a range 0 to 
ny-1, and said control signal generator means applies 
control signals to said first and second dimension encoder 
means according to the output values of both of the 
aforesaid coimters. 
Brief Description of the Drawings 

The invention will now be described, by way of 
example, with reference to the accompanying drawings, in 
which : 

Figure 1 shows, in schematic form, a manner of 
operation of the present invention utilising a two- 
dimensional encoded array. 

Figure 2 shows an apparatus for producing a two- 
dimensional turbo product code in accordance with this 
invention. 

Figure 3 shows, in block schematic form, a Hamming 
parity generator used in an embodiment of this invention. 

Figure 4 shows, in block schematic form, a Hamming 
generator for generating an extended parity bit. 



Figure 5 shows, in block schematic form, a preferred 
embodiment of an apparatus in accordance with this 
invention, and 

Figure 6 shows, in schematic form, a manner of 
control logic generation used in this invention. 

In the Figures like reference numerals denote like 
parts . 

Description of the Preferred Embodiment 

An embodiment of the invention will now be described 
in relation to the use of Hamming codes where bits are 
employed, but it is to be understood that the invention is 
applicable also to other more complex types of code where, 
instead of bits, bytes are used so that the term "bit", as 
used in the description of the preferred embodiment, is in 
a general case, synonymous with "information element", 
which may be data or parity. 

Referring to Figure 1, a data element input stream 1 
comprising data bits do, di, . . .dkxky-i is applied to an 
encoding matrix 2 having constituent codes Cx and Cy. The 
first dimension code Cx is formed by k^ data bits forming 
first dimension data vectors from which first dimension 
parity vectors are computed having n^-kx parity bits. 
These parity bits are appended to the data bits to give an 
overall code length of nx bits. Similarly, the array in a 
second dimension has code Cy formed of ky data bits forming 
second dimension data vectors and second dimension parity 
vectors formed by nyky parity bits, and overall length ny 
bits. A two-dimensional array is shown in Figure 1 but it 
will be understood that a three-dimensional array having a 
third dimension code Cz may be provided and such an array 
is intended to be within the scope of this invention. 

Data is applied in horizontal rows starting from the 
top left corner of the array, horizontal parity vectors 
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evaluated and data is read out from the matrix row by row, 
as shown by the data output 3. Thus, in a preferred 
embodiment, data in a first row {do to d^x-D is read out 
followed by parity elements associated with that row (po to 
Pnx-kx-i) before reading out data elements from the next row 
(dkx to d2kx-i) and the parity elements associated therewith 
(Pnx-kx to P2iix-kx) -i) . The matrix is filled and sequentially 
read out, as shown in Figure 1, until ky first dimension 
code vectors have been read out, whereupon vertical parity 
is evaluated and read out. It will be appreciated that 
vertical parity for the column commencing with data bit do 
may be evaluated as soon as data bit d(ky-i)kx has been added 
to the matrix. The process of evaluating vertical parity 
and reading out the vertical parity continues until the 
last parity bit Pnxny-kxky-i is read out. 

It is to be understood that for applications of the 
invention where the transmission channel has no memory, 
such as satellite links^ the order in which the bits are 
read out is not important. However, for the purposes of 
designing an encoder, the memory requirement is minimised 
if the bits are read out in a row by row order starting 
with the top row. 

Referring to Figure 2, data at input terminal 11 is 
applied to an encoder 12 for a first dimension, for 
example, for the horizontal code Cx having length n^ 
elements. The encoder 12 may be a single extended Hamming 
encoder to be described in more detail hereinbelow. 

Output from encoder 12 is applied to a 
routing/switching device 13 which does not contain memory 
and output from the device 13 is applied to a first 
encoder 14, a second encoder 15 ... n^ encoder 16 for the 
second dimension, e.g. nx encoders for the vertical 
dimension code Cy having bit length ny. An output from 



11 



each of the encoders 14-16 is applied to a further 
routing/ switching device 17 which provides a turbo product 
encoded output to output terminal 18 for onward data 
t r ansmi s s i on . 

The encoders 12, 14-16 and devices 13, 17 are 
controlled by control logic 19 which also produces a 
control data output applied to terminal 20. 

Thus, for a two-dimensional turbo product code, the 
architecture of the present invention comprises one 
encoder for a first dimension nx, k^, and nx encoders for 
the ny, ky (second) dimension, i.e. one encoder for each 
column . 

The overall latency for the present invention is the 
combined latency of both the encoder for the first 
dimension and the encoder for the second dimension, e.g. 
the encoder 12 and one of the encoders 14. An extended 
Hamming code may be implemented with a delay of only two 
clock cycles of one dimension. Thus, the overall latency 
of the present invention is only four clock cycles for a 
two-dimensional array whatever the n, k parameters for the 
Hamming codes that may have been chosen. 

Where a turbo product code of dimensions (64, 57) by 
(64, 57) is required, the latency improvement over the 
prior art is 99.93%. Moreover, with extended Hamming 
codes, the present invention may be readily parameterised 
to allow shortening of either or both codes to an n-s, k-s 
code simply by changing the maximum value of the counters 
to be described hereinbelow with reference to Figure 5. 

In the arrangement of Figure 2 it is to be understood 
that only a two-dimensional product code generation 
apparatus is shown, but a three-dimensional apparatus may 
be implemented by applying outputs from the device 17 to 
(nx Uy) , nz, kz encoders for a third dimension. Output from 
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each of the encoders of the third dimension would then be 
applied to a further routing/ switching device for output. 
It is to be noted that although data input may not be 
continuous, data output at terminal 18 may be continuous 
because data is read according to the data input control 
at terminal 20 . 

A Hamming parity code generator is shown in Figure 3 
having a data input terminal 31, a gate input terminal 32, 
state in terminals 33, state out terminals 34 and a parity 
out terminal 35. 

The generator shown in Figure 3 is for a Hamming code 
of size up to and including n=63, k=57, where the length n 
of the Hamming code is one less than the total number of 
data bits in the complete (extended Hamming) code and k is 
the number of data bits kx in the complete code. The 
generator has an input data XOR gate 3 6 providing parity 
out signals to terminal 3 5 and to a 0 input of a 
multiplexer 37, the 1 input of the multiplexer 37 being 
connected to signal level 0. The multiplexer 37 is 
controlled by signals at the gate terminal 32. An output 
of multiplexer 37 is passed to an input of each of six AND 
gates 38, the other input of each AND gate being connected 
to an appropriate coefficient go to gs which represent a 
polynomial from which the Hamming code is constructed. 
Output from the AND gate 38 connected to coefficient go is 
provided to a first memory element bo and the delayed 
output from memory element bo is provided via terminals 33, 
34 to an input of an XOR gate 39 and thence to a second 
memory element bi. The output of the AND gate associated 
with coefficient gi is also provided to the input of XOR 
gate 39. The output of the second memory element bi is 
applied to an associated output terminal 34, thence via an 
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input terminal 33 to an XOR gate 3 9 associated with 
multiplier ga, and so on as shown in Figure 3. 

In operation, a user specifies the polynomial of the 
code to be generated and the bits of coefficients go-gs are 
set accordingly. For example, the polynomial Xg+x+l would 
have generating bits for multipliers set as follows: 

go=l, gi=l, 92=0, 93=0, g4=0, gg^O 

Such a polynomial is appropriate for a Hamming code 
n=63, k=57. For a code with fewer parity bits, e.g. n=31, 
k=2 6, a different polynomial would be used, e.g. x^+x+1. 
In such a case, the bits of the coefficients could be 
generated as follows: 

go=0, gi=l, g2=l, g3=0, g4=0, g5=0 

At start up, the memory elements bo-bs have a 0 state. 

The operation of the multiplexer 37 is such that when 
the gating signal applied at terminal 32 is 0, the 
multiplexer outputs the signal that is presented at its 0 
input terminal. When the gating signal is 1, the 
multiplexer outputs the signal at its 1 input, i.e. 0. 

Assuming coefficients go=l, gi=l, g2 ... , g5=0, then 
with the multiplexer 37 gate input set at 0, the value of 
the first bit of data do at terminal 31 is passed through 
multipliers associated with coefficients go and gi so that 
the value of the first bit is loaded into memory elements 
bo and bi. When the next data bit di is applied to input 
terminal 31 and is passed to memory element bo, memory 
element bi now contains data bits do+di, and memory element 
ba contains data element do- This process continues for a 
total of k cycles, but it will be noted that after five 
cycles, the state of memory element bs may be 1 or 0 and 
this value is XORed with the input data. 

Following k cycles of data input, the gate signal of 
multiplexer 37 is set to 1 and the parity generator is 
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turned into a simple shift register. Parity is read out 
on successive cycles when data in is set to 0. As each 
data bit is read out, O's are shifted in so that the 
memory elements bo-bs each contain 0 after the final parity 
5 bit is read. 

It is to be noted that because extended Hamming codes 
are used, there will be one cycle for which the Hamming 
parity generator is idle. 

If it is desired to implement a shortened code, e.g. 

10 n=62, k=56, this can be accomplished by simply clocking 
less data samples. 

So as to generate an extended Hamming code, the sum 
modulo 2 of all the data and Hamming parity bits in the 
code word are calculated and appended as an extra parity 

15 bit. Such a circuit for generating an extended Hamming 
code is shown in Figure 4 in which a Hamming code 
comprising data and Hamming parity bits is applied to an 
input terminal 41. Terminal 41 is connected to an XOR 
gate 42. Output from gate 42 is applied to output 

20 terminal 46 and a 0 input of a multiplexer 43 having its 
other, 1, input connected to be supplied with a 0 level. 
The multiplexer 43 is controlled by a gate signal applied 
at terminal 47. Output from the multiplexer 43 is 
provided to a memory element 44 which supplies an output 

25 to another input of gate 42, via terminals 49 and 48. 

Thus, the extended parity bit is calculated by the 
generator shown in Figure 4 having a single memory 
element. Starting from a memory element initial state 
where bo=0, the generator performs an XOR function of the 

30 incoming bit with the contents of memory element 44. This 
is repeated for all the data bits and the Hamming parity 
bits, after which the multiplexer 43 is set to 1. The 
extended parity generator is read and cleared, ands 
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simultaneously passes a valid extended parity bit to 
multiplexer mxe or mye (described herein below) as 
appropriate . 

A preferred embodiment of a parameterised encoder for 
a (64, 57) X (64, 57) two-dimensional turbo product code 
using extended Hamming encoders will now be described with 
reference to Figure 5. 

In Figure 5, date input terminal 11 is connected to a 
0 input of multiplexer m^, the other, 1, input terminal of 
the multiplexer m± being connected to input terminal 51 for 
receiving a 0 level indicative of no data. Output from 
the multiplexer mi is applied to encoder 12 for the first 
dimension which is formed of an extended Hamming generator 
Gxh having the architecture shown in Figure 3, a 
multiplexer raxh, an extended Hamming generator Gxe having 
the architecture shown in Figure 4 and another multiplexer 
mxe. Output from multiplexer mi is applied to input 
terminal 31 of Hamming generator Gxh and to the 0 input of 
the multiplexer mxh, the 1 input of multiplexer being 
connected to receive input from output terminal 35. 
Output from multiplexer mxh is applied to extended Hamming 
generator Gxe and to the 0 input of the multiplexer mxe, the 
parity output terminal 46 is applied to the 1 input 
terminal of multiplexer mxe. Output from multiplexer mxe, 
forming output from the first dimension encoder 12, is 
applied to the second dimension encoder arrangement 22 
formed by the routing/ switching devices 13, 17 and the 
second dimension encoders 14-16. The Hamming generator Gyh 
for the second dimension is constructed similarly to the 
Hamming generator Gxh of the first dimension and, 
similarly, the multiplexer myh is connected to receive 
inputs from the multiplexer Gyh. The multiplexer mxe is 
similar to the multiplexer mxh- Further, the extended 
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Hamming generator Gye for the second dimension is similar 
to the extended Hamming generator Gxe for the first 
dimension and multiplexer mye connected to receive output 
from the extended Hamming generator Gye- The multiplexer myh 
5 is similar to the multiplexer mxe- Output from the 

multiplexer mye forms the turbo product code and is applied 
to output terminal 52 for use in a transmission channel. 

The preferred embodiment of Figure 5, instead of 
requiring nx second encoders utilises random access 

10 memories (RAM) Ryh and Rye. RAM Ryh is connected between 
state out terminal 34 and state in terminal 33. 
Similarly, RAM Rye is connected between state out terminal 
49 and state in terminal 48. By using such an arrangement 
of RAM, the necessity for plural second dimension encoders 

15 is avoided in practice so that, in effect, the plural 
encoders are synthesized. The control logic 17 has a 
first dimension counter 53 for providing a count Cx in the 
counter range 0 to nx-1 and a second dimension counter 54 
for providing a second dimension count Cy in the counter 

2 0 range 0 to nyl. The data input control terminal 18 is 
connected to the counter 53 and an output of the counter 
53 is connected to a control signal generation circuit 55 
which provides: control signal Si to multiplexer mi; 
control signal Sxh to the Hamming generator multiplexer mxh 

25 and terminal 32; control signal Sxe to the extended Hamming 
generator multiplexer mxe and to input terminal 47; control 
signal ryh to provide a read signal address to RAM Ryh and a 
write signal address Wyh to RAM Ryh; control signal Syh is 
applied to Hamming multiplexer myh and to input terminal 32 

30 of generator Gyh; a read address signal rye is applied to 
RAM Rye and a write Wye address signal is applied to RAM 
Rye; and a control signal Sye is applied to extended Hamming 
multiplexer mye and to input terminal 47 of generator Gye- 
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The circuit 55 also provides an increment signal to 
increment the second dimension counter 54 and receives an 
output signal representative of Cy from counter 54. 

The operation of Figure 5 will now be described. 
5 When the control signals Si, Sxh, Sxe/ Syn, Sye are 0, 

the value at the data input terminal 11 is passed to the 
output of the respective, relevant, multiplexer mi, m^h, 
^e, iHyh, mye. When the control signal Si, etc. is 1, the 
value at input terminal 51, i.e. 0, is passed to the 

10 output of the respective multipliers. When the data input 
control signal applied at terminal 18 is high, e.g. 1, the 
counter 53 increases its output count Cx by 1. If this 
causes the count to have a value nx then the count is reset 
to 0. The control signal generation circuit 55 produces 

15 an enabling pulse which is generated from the counter 53 
count value Cx so that the counter 54 count Cy is 
incremented as the count Cx reaches the beginning of each 
new line and is reset to 0. 

The action of each of the parity generators Gxh/ Gxe, 

20 Gyh, Gye is as follows. 

Each parity generator has five terminals, namely, 
input data terminal 31 or 41, output terminal 35 or 46, 
control data, i.e. gate, terminal 32 or 47, output state 
terminal 34 or 49 and input state terminal 33 or 48. When 

25 the gate terminal 32 or 47 is low, the parity generator 
produces an output state from the input state and the 
input data bit, according to the internal logic of the 
generator, which embodies the desired code determined by a 
user, e.g. a (64, 57) code or a (32, 26) code. When the 

30 gate terminal is high, parity bits are presented at the 
relevant parity output terminal 35 or 46. After the 
parity bits have been read, the output state will be all 
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O's so that the parity generator is ready for the start of 
the next code word. 

Each dual port RAM Ryh, Rye is configured to have one 
read port and one write port, the respective read ports 
being controlled by address signals ryh and rye and the 
respective write ports being controlled by address signal 
Wyh and Wye. Data is read out of RAM Ryu or Rye via terminal 
33 or 48 respectively in accordance with a RAM address 
location set by read address signal ryh or rye respectively. 
Simultaneously, data from terminals 34, 49 

at a data in port of RAM Ryh and Rye respectively is written 
to a RAM memory address set by write address Wyu or Wye 
respectively. 

In the preferred embodiment, dual port RAMs are used 
to store the state of the parity generators in the second 
dimension rather than to provide a separate parity 
generator for every column in the two dimensional array. 
Therefore, by storing and fetching the states for each 
column the effect of an encoder for each of nx columns is 
synthesized, using only one Hamming parity generator and 
one extended parity generator. Thus, a considerable 
reduction in the gate count for a field programmable gate 
array implementation is provided. 

Figure 6 shows the manner by which the control signal 
generation circuit 55 produces the control signals Si, S^h, 
Sxef Syh, Sye. Thus, for the first row Cy=0, horizontal 
count signals c^ from 0 to nx-1 are produced before moving 
down the block to the second row Cy = 1, etc. until the 
last row Cy = ny-1. 

It will be appreciated by those skilled in the art 
that the values must be delayed in order to take account 
of increasing latency in the data path as data moves 
through the data path of Figure 5. 
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The read and write addresses are rxh, r^e, Wyh, Wye are 
the value of the count Cx that has been delayed by an 
appropriate amount so that the correct value of the 
encoder state for any column, i.e. the second dimension, 
is presented at the input to the relevant parity generator 
at the correct moment of time, and the results of the 
parity calculation is stored back in the same location a 
short time later, thereby synthesizing the desired effect 
of having plural second dimension encoders. 

A step-by- step operation of the embodiment shown in 
Figure 5 will now be described. 

Encoding starts with Cx=0, Cy=0 and the contents of 
RAMs Ryh, Rye and internal states of the multiplexers and 
generators are set to 0 . 

Time step 1 : 

First data element do is present at the input 11 of 
multiplexer mi. Since Si=0, the data element do is passed 
to the 0 input of multiplexer m^h and input terminal 31 of 
Hamming generator Gxh- 

Time step 2 : 

A second data element di is present on the input 11 of 
multiplexer mi. This is passed to the input of multiplexer 
mhx and Hamming generator Gxh- Simultaneously, the first 
data element is already present on the input of 
multiplexer mxe and is passed to the output of multiplexer 
mxe. At the same time, the state of the Hamming generator 
Gxh is updated and the state thereof is fed directly back 
to the input thereof. 

Time step 3 : 

A third data element d2 is present on the input of 
multiplexer mi. This is passed to the input of multiplexer 
mxh and Hamming generator Gxh- Simultaneously, the previous 
element di is present on the 0 input of multiplexer mxe and 
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is passed to the output of multiplexer mxe- At the same 
time, the state of the horizontal (first dimension) 
Hamming generator G^e is updated from the data element di - 
the output state is fed directly back to the input of 
generator Gxh- Concurrently, the horizontal (first 
dimension) extended Hamming parity generator Gxe operates 
on the data element do. Again, the state generated by 
generator Gxe is fed directly back to the input of Gxe. 
Time step 4 : 

A fourth element da is present on the 0 input of 
multiplexer mi. This is passed to the 0 input of the 
multiplexer m^h and on to the output of mxe- At the same 
time, the state of the horizontal Hamming generator Gxe is 
updated from the data element da - the output state of 
generator Gxh is fed directly back to the input of 
generator Gxh- Concurrently, the horizontal extended 
parity generator Gxe operates on the data element di and 
the vertical Hamming generator Gxh operates on data element 
do. 

Time step 5 : 

A fifth data element d4 is present on the 0 input of 
multiplexer mi. This is passed to the 0 input of 
multiplexer mxh and to the input terminal 31 of generator 
Gxh. At the same time, the state of the Hamming generator 
Gxh is updated from the data element da - the output state 
of generator Gxh is fed directly back to the input thereof. 
Concurrently, the horizontal extended parity generator Gxe 
operates on the data element dz, the vertical Hamming 
parity generator Gyh operates on data element di and the 
vertical extended parity generator Gye operates on data 
element do . 

Time step 6 : 
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A sixth data element ds is present on the 0 input of 
multiplexer mi. This is passed to the 0 input of 
multiplexer m^h and terminal 31 of generator Gxh- 
Simultaneously, the previous element is already present on 
the 0 input of multiplexer mxe and is passed to the output 
thereof. At the same time, the state of the generator Gxh 
is updated from the data element d4 - the state of the 
generator Gxn is fed directly back to the input thereof. 
Concurrently, the horizontal extended parity generator Gye 
operates on the data element da, the Hamming parity 
generator Gyt, operates on data element da and the vertical 
extended parity generator Gye operates on data element di. 
The first element of the output word, data element do, is 
passed to multiplexer mye and output at terminal 52. 

The operation continues in similar fashion until time 
step kx, at which point count Cx=kx-1, and count Cy=0. 

Time step kx+1 : 

The control signal Si now has a value of 1. No data 
is input. Data element dkx-i is already present on the 
input of multiplexer m^h and is passed to the output 
thereof. At the same time, the state of the horizontal 
Hamming generator Gxh is updated from the data element dkx - 
the output state of generator Gxh is fed directly back to 
the input thereof. Concurrently, the horizontal extended 
parity generator Gxe operates on the data element dkx-i, the 
vertical Hamming parity generator Gyh operates on data 
element dkx-2 and the vertical extended parity generator Gye 
operates on data element dkx-3. Data element dkx_4 is output 
at terminal 52 . 

Time step kx+2 : 

Having compensated for the delay introduced by mi, 
control signal Sxh now has the value 1. Parity element Po 
is present at the input of multiplexer mxh and the parity 
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element is passed through to the output of multiplexer mxh- 
Concurrently, the horizontal extended parity generator Gxe 
operates on the data element dkx, the vertical Hamming 
parity generator Gyh operates on data element dkh-i and the 
vertical extended parity generator Gye operates on data 
element dkx-2. Data element dkh-s is output at tenninal 52. 

The operation continues in a similar fashion until 
time step nx, at which point Cx=nx-1, Cy=0. Parity 
generator Gxh has been cleared by the successive writing 
out of its contents over the preceding time steps. 

Typically, 3 to 7 parity bits may predeterminedly be 

used. 

Time step nx+1 : 

At this time Cx=0, Cy=l. The encoder now begins 
processing the second row of data whilst the final bits of 
the first row are still being processed. Bit d^x is 
present at the input of mi. 

Time step nx{ky-l)+kx: 

All the data for the block has now been input. 
Time step n^ky+e : 

The number 6 denotes the latency of the encoder. 
Parity generators Gxh and Gxe are idle at nxky+1. The 
encoder outputs vertical code (second dimension) having 
parity but is still calculating vertical (second 
dimension) extended parity. The successive clocking out 
of the parity causes the state of the generators Gxh, Gxe, 
Gyh, Gye to be reset, as explained above, with regard to 
Figures 3 and 4 . 

Time step nx(ny-l)+6: 

The encoder outputs at terminal 52 vertical extended 
parity which is a product code. Each extended parity 
state is cleared to 0 after it is read. 
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Operation of the encoder may be continuous so that it 
begins processing the second turbo product code block as 
the final few bits of the first block are being output so 
that there is no interruption of the data stream. 
5 For higher dimensional turbo product codes the number 

of encoders and routing/ switching devices will increase 
for the same overall code length, but the latency will 
increase only linearly. Thus, a three-dimensional turbo 
product code having the same overall product length as a 
10 two-dimensional code having parameters of, say, 16, 11 by 
16, 11 will have a delay of only six clock cycles, but 
will require 1+16+256 = 275 (16, 11) extended Hamming 
encoders . 

It will, therefore, be seen that the latency 
15 introduced by the present invention is sxibstantially 
improved over the prior art device. 

Further, it is to be understood that modifications 
could be made and that all such modifications falling 
within the spirit and scope of the appended claims are 
20 intended to be included in the present invention. 



